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In a marketized environment, ESL providers, in common with other postcompul- 
sory educational institutions, canvass student satisfaction with their services. 
While the predominant method is likely to be based on tick-box questionnaires 
using Likert scales that measure degrees of satisfaction, qualitative methodology 
is an option when rich data is desired. The well-established Critical Incident Tech¬ 
nique (CIT) is particularly useful in this regard as an exploratory methodology 
with potential to increase knowledge about previously unknown phenomena. A 
pilot study with a small sample of ESL students was set up to explore ESL student 
satisfaction using CIT. The data obtained were analyzed within the framework of 
Johnston's (1995) quality factors, then further categorized in terms of satisfying, 
dissatisfying, or neutral factors. The findings provided some tentative indications 
of differentiation among ESL quality factors as perceived by ESL students. In¬ 
sights were obtained regarding procedural, analytical, and student response issues 
in the use of CIT in conjunction with satisfaction data. The outcomes supported 
the view that information obtained through CIT could assist ESL managers and 
teachers in developing and enhancing quality factors that more accurately reflect 
student expectations of the service. 

Dans un environnement commercialise, les fournisseurs en AES, tout comme 
les autres institutions postsecondaires, sondent les etudiants pour connaitre leur 
niveau de satisfaction avec les services qu'ils offrent. Alors que la methode la 
plus couramment employee repose sur des questionnaires a choix multiples avec 
des echelles de Likert pour mesurer les niveaux de satisfaction, une methodolo- 
gie qualitative est a envisager quand Ton desire des donnees approfondies. La 
methode des incidents critiques (CIT) est bien etablie et particulierement utile a 
cet egard, etant une methodologie d'exploration avec le potentiel d'accroitre les 
connaissances de phenomenes inconnus auparavant. On a mis sur pied une etude 
pilote avec un petit echantillon d’etudiants en ALS pour explorer, par la CIT, leur 
niveau de satisfaction. Les donnees out ete analysees dans le cadre desfacteurs de 
qualite de Johnston (1995) et ensuite categorisees enfonction defacteurs satisfai- 
sants, insatisfaisants et neutres. Les resultats fournissent des indices de differen¬ 
tiation parmi lesfacteurs de qualite en ALS, tels que pergus par les etudiants. De 
nouvelles idees sont ressorties par rapport a Vemploi de la CIT et les enjeux lies a 
la procedure, Vanalyse et les reponses des etudiants dans le contexte de donnees 
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relatives a la satisfaction. La conclusion en est que les informations decoulant de 
la CIT pourraient appuyer les administrateurs et les enseignants dans le deve- 
loppement et l'amelioration desfacteurs de qualite de sorte a mieux repondre aux 
attentes des etudiants en matiere des services. 


"Service practitioners understand the importance of measuring customer 
evaluations, such as service quality and customer satisfaction, on a regular 
basis" (Dabholkar & Overby, 2005, p. 21). By actively soliciting customer feed¬ 
back, service operations managers can identify ongoing or potential prob¬ 
lems with a view to improving service performance (Pugh, Dietz, Wiley, & 
Brooks, 2002). Since many Western postcompulsory educational institutions 
operate in a context of marketized education, it has likewise become com¬ 
monplace to canvass student satisfaction with services offered (Riggan, 2012; 
Thomas & Cunningham, 2009). Correspondingly, scholarly papers examining 
various aspects of student satisfaction with postcompulsory educational ser¬ 
vices have proliferated (e.g., Kuo, Walker, Belland, & Schroder, 2013; Mark, 
2013; Moore, 2011; Serenko, 2011; Sorden & Munene, 2013; Wood & Vasquez 
Urias, 2012). However, this flowering of scholarly interest has not been rep¬ 
licated in the field of English as a Second Language (ESL) because, with only 
a few exceptions (e.g.. Walker, 2010) the theme of ESL student satisfaction 
with ESL services is absent from the literature. ESL providers undoubtedly 
survey their students as a matter of course, at least in well-regulated envi¬ 
ronments, but apart from some publicly funded surveys, information about 
issues or findings is not normally available in the public domain. As a result, 
the methods providers use to obtain satisfaction data also remain somewhat 
obscure. Anecdotally, the staple choice for many institutions will be some 
form of "tick-box" questionnaire akin to that in the 2006 ELICOS (English 
Language Intensive Courses for Overseas Students) survey (Australian Edu¬ 
cation International, 2007), which used a 5-point Likert scale from very dis¬ 
satisfied to very satisfied to question respondents about specific aspects of their 
English language study experience. With their standard quantitative design, 
such instruments undoubtedly represent popular, low-cost options that are 
efficient to administer and process, as well as being straightforward for users. 
However, despite their obvious utility, they are subject to the stock criticisms 
of survey methodology that uses forced-choice formats, for instance, poten¬ 
tially skewed findings resulting from an insufficient range of alternatives, or 
the inability of respondents to qualify or augment their responses (de Vaus, 
2002). Furthermore, survey administrators receive responses only to the items 
they choose to include in the questionnaire. 

For these reasons, qualitative methodologies such as interviews, focus 
groups, or open-ended questionnaires might present attractive options, tak¬ 
ing account, as they do, of the fact that people "ascribe meanings, thoughts. 
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and feelings to the situation in which they find themselves," as organiza¬ 
tions are "both social systems and the setting for social behaviour" (Maylor & 
Blackmon, 2005, p. 220). Indeed, ESL providers may include some qualitative 
methods in their survey activities despite disincentives, such as the time- 
consuming nature of data collection and analysis and the cost involved. These 
problems notwithstanding, the rich data (Holloway, 1997) obtained from stu¬ 
dents by way of qualitative survey methods can provide managers and teach¬ 
ers with a clearer and potentially more useful picture of student satisfaction 
with their institutions than could be obtained by a tick-box survey alone. One 
such qualitative method is the Critical Incident Technique (CIT). Could this 
well-established technique be of potential use to ESL managers and teachers 
in comprehending the nature of student satisfaction with their services? 

Conceptual and Theoretical Issues 

Using critical incidents 

A critical incident is "any observable human activity that is sufficiently 
complete in itself to permit inferences and predictions to be made about the 
person performing the act," and that has a clear purpose and intent, the con¬ 
sequences of which "are sufficiently definite to leave little doubt concerning 
its effects" (Flanagan, 1954, p. 327). Because respondents are able to express 
themselves in their own words and in as detailed a manner as the researcher 
allows, CIT has the potential to glean rich, concrete, and detailed information 
on the activity under investigation from the perspective of the participant, 
thus allowing researchers "to rigorously study a phenomenon and identify 
issues not previously considered" (Gremler, 2004, p. 69; my emphasis). Simply 
put, survey participants are asked to recount anecdotes that highlight some 
aspect(s) of their experiences in a particular context. The resulting data can 
be content analyzed and classified in order to "provide insights regarding 
the frequency and patterns of factors that affect the phenomenon of interest" 
(Gremler, 2004, p. 66). 

CIT has been used in a wide range of research fields, in particular ser¬ 
vices research (e.g., Bitner, Booms, & Mohr, 1994; Edvardsson, 1992; Hoffman, 
Kelley, & Chung, 2003; Holloway & Beatty, 2008; Johnston, 1995; Mangold, 
Miller, & Brockway, 1999). It has also become popular in educational research, 
for instance, to explore student satisfaction with e-learning (Chen, Lin, & Kin- 
shuk, 2008), teacher education (Harrison & Lee, 2011), classroom encounters 
(Voss, 2009), and student satisfaction with the higher education experience 
(Douglas, McClelland, & Davies, 2008). CIT's facility to identify issues unrec¬ 
ognized at the time of the research (Gremler, 2004) represents a major advan¬ 
tage over standard tick-box surveys. Thus, CIT is considered appropriate as 
an exploratory methodology intended to increase knowledge about previ¬ 
ously unknown phenomena (Bitner, Booms, & Tetreault, 1990), particularly 
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in educational service contexts (Douglas, McClelland, Davies, & Sudbury, 
2009). However, CIT does have some obvious drawbacks. In common with 
other qualitative research methods it may be time-consuming to administer 
and process, and suffer from a lower response rate than that obtainable from 
the run-of-the-mill questionnaire. There are issues with respondent recall of 
incidents (Edvardsson & Roos, 2001) and problems achieving valid and reli¬ 
able analysis of the material collected (Vargo, Nagao, He, & Morgan, 2007). 

Service quality and customer satisfaction 

Despite persistent controversies (e.g., Martinez & Martinez, 2010), the link be¬ 
tween perceived service quality and customer satisfaction has been reiterated 
in the services management/marketing literature (e.g., Carrillat, Jaramillo, & 
Mulki, 2009; Gronroos, 2007; Maddern, Maull, Smart, & Baker, 2007). Thus 
customers who perceive quality are likely to be satisfied. This conclusion 
has led researchers to attempt to identify attributes that determine service 
quality within specific service types (e.g., Aldhizer, Turner, & Shank, 2002; 
Kelley & Turley, 2001; Ramsaran-Fowdar, 2005). If such service quality fac¬ 
tors or determinants (Johnston, 1995) can be described and catalogued, the 
information could assist service managers to focus their efforts, set priorities, 
and thus improve the efficiency and effectiveness of their service operations. 
Customer satisfaction is commonly framed within the discontinuation of ex¬ 
pectations (DE) paradigm, namely, an outcome of the comparison customers 
make between their prepurchase expectations of the service performance and 
postpurchase perceptions of that performance (Cardozo, 1965; Churchill & 
Suprenant, 1982; Oliver, 1980). However, despite its widespread application 
and relatively strong support in the literature (e.g., Gutek, Groth, & Cherry, 
2002; Szymanski & Henard, 2001; Yi, 1990), the DE paradigm is limited due to 
an inability to incorporate some of the complexities involved in the global sat¬ 
isfaction process (Vargo et al., 2007) as consumers may respond differently to 
different aspects of service provision in terms of variation in degrees of satis¬ 
faction, dissatisfaction, or even indifference. Furthermore, "there may well be 
a difference between the causes of satisfaction and dissatisfaction" (Johnston, 
1995, p. 58). Where an estimation of ESL student satisfaction is concerned, this 
potential for differentiation is further compounded by issues such as ethnicity 
and cultural influences (Johnson, Herrmann, & Gustafsson, 2002; Ueltshchy 
& Krampf, 2001); language, in terms of accurate respondent comprehension 
of survey questions, and accuracy of written or verbal responses; and age, in 
terms of limited knowledge, experience, and maturity about, for example, the 
validity of teaching methodologies (Szymanski & Henard, 2001) or expecta¬ 
tions of proficiency gain. 

In an attempt to respond to such issues, a number of researchers (Cadotte 
& Turgeon, 1988; Johnston, 1995; Johnston & Sylvestro, 1990; Lockwood, 
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1994) suggested a refinement of the customer satisfaction process focused on 
the operation of four service quality factor categories: 

1. Hygiene factors ( Hygienes or Dissatisfiers) are factors that are likely to 
cause dissatisfaction if of poor quality or absent, but do not increase sat¬ 
isfaction if they are present or of high quality. They are the basic expecta¬ 
tions or requirements of a service from the customer point of view, satisfy 
extrinsic human needs, and tend to be of a functional and/or instrumental 
nature (Vargo et al., 2007), but are not likely to be a source of great satis¬ 
faction or delight. For instance, students expect to find chairs and desks in 
their classrooms. The presence of these items does not engender satisfac¬ 
tion, but their absence would likely cause dissatisfaction. 

2. Enhancing factors (Enhancers or Satisfiers) are factors that can elicit great 
satisfaction or delight from customers if they are present, but are unlikely 
to be grounds for dissatisfaction if they are not. They tend to have the 
characteristic of "add-ons," signifying augmented features of the service 
that clients may not necessarily anticipate. An authentic example occurred 
when ESL staff turned out in the middle of the night to assist students 
involved in an automobile accident. 

3. Critical factors ( Criticals ) can both delight and dissatisfy clients and, as 
their name implies, they are key aspects of the service, representing the 
core features of particular importance to clients (Vargo et al., 2007). These 
are harder to classify, but previous ESL research (Walker, 2010) identified 
teaching skills and lesson effectiveness as strong predictors of ESL student 
satisfaction. Such issues might therefore represent critical factors for ESL 
students. 

4. Neutral factors ( Neutrals ) are those that have little influence on satisfaction 
or dissatisfaction. In exploratory focus group research (Walker, 2010), ESL 
student participants appeared unconcerned about the servicescape (Bitner, 
1992) in terms of decor, lighting, or appearance. It may be that these ele¬ 
ments were neutral factors for respondents. 

The significance of specific service quality factors and/or service features 
may evolve and change over time, resulting in reassignment to a different 
category. For instance, satisfiers can become criticals and then hygienes, often 
in conjunction with technological innovation (Vargo et al., 2007). A good ex¬ 
ample is broadband access for students. In the early days of the Internet, 
this was something of a bonus in ESL services. Nowadays, it is a standard 
feature. Thus it has migrated from an enhancer role to that of a critical or even 
a hygiene. The utility for service organizations of this approach lies in more 
efficient and effective priority setting, thus enabling managers to focus on the 
issues that really matter to customers, while allotting less effort to those that 
do not. Johnston's (1995) research resulted in the identification of 18 quality 
factors that could influence customer satisfaction with a service (Appendix 
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A) . Although not necessarily exhaustive, these factors have constituted a use¬ 
ful basis for further satisfaction studies. 

Given its attributes, CIT has been regarded as a suitable choice for re¬ 
search investigating quality and customer/client satisfaction. While there 
may be overfocus on extremes of satisfaction or dissatisfaction in the data, 
meaning that many less memorable incidents may not be collected (Strauss 
& Weinlich, 1997), CIT allows respondents to narrate first-hand experiences, 
which researchers can analyze and classify into critical incidents of high and 
low satisfaction and dissatisfaction. Since the use of CIT for this purpose is 
expanding into a number of research areas, including education (e.g., Doug¬ 
las et al., 2008; Voss, 2009), it appears an appropriate vehicle to explore ESL 
student satisfaction. 

A Pilot Study 

Taking these issues into account, a simple pilot study was set up in a uni¬ 
versity English language centre in order to test the utility of CIT with ESL 
students. Human ethics clearance was obtained from university authorities. A 
general invitation was sent out to currently enrolled students to participate in 
the research, and 23 students accepted. The students were assembled in one 
group, and the researcher explained the purpose of the research. They were 
asked to write about two critical incidents that, respectively, made them very 
pleased/satisfied and very unhappy/dissatisfied with the service they were 
receiving from the centre, and to explain why they felt that way in each case. 
The respondents' stories were captured on a paper survey form (Appendix 

B) , which also asked for demographic data. Each critical incident narrated 
was regarded as one unit of analysis. The data were content analyzed by the 
researcher, assisted by an independent "judge" in line with Gremler's (2004) 
recommendations, with the aim of classifying critical incidents within John¬ 
ston's (1995) framework of quality factor categories. 

Findings and Discussion 

Overview of findings 

The demographic data are shown in Table 1. There was a good gender bal¬ 
ance; students were from Asia and the Middle East, and mainly in the age 
group 21-30. Most students had studied at the centre for five months or less. 

Johnston's (1995) quality factors were derived from banking services re¬ 
search. By his own admission, they could probably not be generalized to all 
service types without augmentation. This was found to be the case in this ESL 
context, as four themes were identified that did not entirely fit any of John¬ 
ston's factors, or appeared to be too important not to designate as discrete 
factors: 
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• Service milieu: This concept refers to the atmosphere, ambience, or mood 
experienced in a service context, which reflects friendly, efficient, and sup¬ 
portive service (Schneider & Bowen, 1995). 

• Socializing: Douglas et al. (2008) augmented Johnston's (1995) factors with 
several new categories specific to education, one of which they labelled 
socializing, that is, the benefit students perceived from making new friends 
and using student facilities. 

• Teaching/learning experience: Given the study context, this theme, unsur¬ 
prisingly, attracted the most comments. 

• Placement/promotion procedure: This encompasses the initial testing and 
placement of students at an appropriate level of proficiency, as well as 
promotion to higher levels. 


Table 1 

Demographics 


Gender 

Female 


Male 



11 


12 


Age 

20 or younger 

21-30 


31-40 


1 

21 


1 

Country 

S. Korea Saudi Arabia 

PR China Thailand 

Japan 


10 5 

4 

2 

2 

Time in Centre 

1 year or more 

6-11 months 

5 months or less 


4 

3 


16 


Content analysis identified a total of 17 quality factors, 13 from John¬ 
ston's (1995) list plus the above 4. A total of 46 positive incidents and 40 
negative incidents were recorded and classified (Table 2) according to the 
augmented list. It can be seen that the most frequently reported incidents 
were in the teaching/learning experience category (16), followed by com¬ 
munication (9) and flexibility (8). Table 3 provides illustrations of reported 
incidents for each category identified. Johnston (1995) acknowledged the 
conspicuous omission of cost of the service from his list, commenting that 
price might be of major importance for customers in some service types. It 
is therefore of interest that a mere three incidents concerned study fees, of 
which only one actually criticized the cost of the service in relation to its 
perceived quality. 
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Table 2 

Summary of Positive and Negative Incidents 


Quality Factor 


Positive 

Negative 

Access 


2 

1 

Attentiveness/helpfulness 


4 

2 

Availability 


0 

2 

Care 


2 

0 

Commitment 


4 

0 

Communication 


5 

4 

Courtesy 


1 

4 

Flexibility 


6 

2 

Friendliness 


4 

0 

Functionality 


0 

4 

Placement/promotion procedures* 


2 

4 

Reliability 


0 

2 

Responsiveness 


1 

3 

Security 


2 

0 

Service milieu* 


4 

0 

Socializing* 


5 

0 

Teaching/learning experience* 


4 

12 

Total 


46 

40 

* = Additional quality factor 

Table 3 

Quality Factors: Illustrative Positive and Negative Incidents 

Category Incident 





Access 


Attentiveness/ 

helpfulness 


Availability 


(+) Student enjoyed using the free bus service. 

(-) Student had problems finding a car park at the centre. 

(+) Staff were helpful and gave advice during admission 
procedures. 

(-) Student got no assistance to book a flight home. 

(-) Student observed students in another group going on weekend 
activity, but she was not offered this service. 


(continued next page) 
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Care 

(+) Student experienced kindness and caring attitude from teachers 
when having personal problems. 

Commitment 

(+) Staff learned and remembered the student’s name. 

Communication 

(+) Staff kept student informed about events at the centre. 

(-) No one took the time to explain the course of study to the 
student or how it would be assessed. 

Courtesy 

(+) Staff treated student respectfully and politely when she 
requested assistance. 

(-) Student felt he and his country were insulted when staff member 
praised the hard work of students from another country. 

Flexibility 

(+) Staff member helped student make appointment for medical 
problem and took student to hospital. 

(-) Student was unable to get fee refund when she had to return 
home early. 

Friendliness 

(+) Coordinators were friendly and smiling on student arrival at 
centre. 

Functionality 

(-) Student found a poor choice of food at the cafeteria. 

Placement/promotion 

procedures* 

(+) When promoted to a higher class, student found interesting new 
topics, activities, and challenges. 

(-) Student was moved to a new class without consultation or 
explanation. 

Reliability 

(-) Student was given incorrect information about fees in home 
country, and had to pay extra fees on arrival in NZ. 

Responsiveness 

(+) Teachers were willing to answer questions from students in and 
out of class. 

(-) Management asked students for feedback but did not act on it. 

Security 

(+) Student was given a contact phone number to use in 
emergencies. 

Service milieu* 

(+) Student found he could learn more effectively because of the 
positive atmosphere in the centre. 

Socializing* 

(+) Student enjoyed opportunity to socialize with students from 
other countries and speak English. 

Teaching/learning 

experience* 

(+) Student enjoyed a particular lesson because teacher used 
music in class. 

(-) In his class, student found too much time devoted to grammar, 
and not enough to speaking and listening. 


* = Additional quality factor 
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Attempting to classify quality factors 

Once the incidents had been matched with quality factors, an attempt was 

made to classify them according to the four service quality factor categories 

(Table 4) as Lockwood (1994) advised: 

• Neutrals: Themes that attracted low scores for both positive and negative 
incidents. 

• Hygienes: Themes that have a high score for negative incidents and a low 
score for positive incidents, since these incidents attract a lot of complaints 
when they go wrong, but not many comments when they go right (Lock- 
wood, 1994). 

• Enhancers: Themes that have a high score for positive incidents but a low 
score for negative incidents. They potentially delight customers, but are 
not negatively commented on if they do not occur. 

• Criticals: Themes that have a high score in terms of both positive and nega¬ 
tive incidents. They "will tend to result in plaudits if everything goes right 
but brickbats if things go wrong" (Lockwood, 1994, p. 78). 


Table 4 

Tentative Classification of Quality Factors for ESL Service 


High 

HYGIENES 

CRITICALS 


Teaching/learning experience 

Communication 

Potential 

Functionality 

Courtesy? 

Placement/promotion procedures? 

Responsiveness? 

Attentiveness/helpfulness? 

to Dissatisfy 

NEUTRALS 

ENHANCERS 


Access? 

Friendliness 


Care? 

Commitment 


Security? 

Service milieu 


Availability? 

Socializing 

Low 

Reliability? 

Flexibility? 


Low Potential to Delight High 


The question of what "high" and "low" scores are is unclear, although 
Lockwood's (1994) advice was to use the Pareto Principle (i.e., 80-20 rule). 
Given the limited nature of the data collected from this small sample of stu¬ 
dents, it was not possible to assign all of these themes with anything near 
100% confidence, but a tentative attempt at classification was made (Table 
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4). A glance at Table 2 would indicate that the enhancers could probably be 
most confidently identified, as no negative incidents were reported, and the 
positive scores are respectable (commitment, friendliness, service milieu, and so- 
cializing). The disparity in scores for flexibility might mandate allocating this 
factor to the enhancers also. The situation with care and security is not so clear, 
but with their low scores they might belong to the neutrals, along with access, 
availability, and reliability. With its strongly negative score, teaching/learning 
experience would appear to be a hygiene factor, along with functionality, and 
although three others might be assigned to this group —courtesy, placement/ 
promotion procedures, and responsiveness —question marks would have to be 
placed against them. The criticals group is, likewise, hard to identify with 
certainty. On balance, it would appear that communication is a critical, and 
attentiveness/helpfulness might belong here, but it might also be an enhancer. 

Several of Johnston's factors could not be assigned, namely aesthetics, 
cleanliness/tidiness, comfort, competence, and integrity. The omission of compe¬ 
tence might appear strange in an educational context. However, only about 
three incidents clearly referred to staff or teacher competence—for instance, 
one where the teaching was of a high standard and another that criticized 
lack of teacher knowledge of requirements for university study. Incidents that 
referred to, for example, teachers using handouts instead of textbooks or not 
focusing on academic English, appeared to relate more to functionality (per¬ 
haps organizational or curriculum issues) than competence. After some dis¬ 
cussion, therefore, it was felt that the teaching/learning experience factor was 
too pertinent to ESL to be deconstructed, so for the purpose of this exercise it 
can be assumed that this factor subsumes some other factors from Johnston's 
(1995) list. Furthermore, there may be a temptation to assign missing factors 
to the neutrals category —that is, they are unimportant because they were 
not "mentioned." However, given the nature of this study, the sample size, 
and the variation in customer experience, it would dangerous to make this 
assumption (Johnston & Heineke, 1998). Even with a respectable sample size 
and a large number of reported incidents, caution would be advised in claim¬ 
ing generalizability for such a classification, unless some common ground 
could be established based on findings across a number of institutions, or 
unless studies could be replicated in different contexts and jurisdictions. 

Student response issues 

Quality of narratives: The written student narratives were in some cases not 
detailed enough to permit accurate analysis and categorization, and the task 
instructions were, in retrospect, deemed to be too vague. Future versions of 
the questionnaire should heed Flanagan's (1954) advice about collecting criti¬ 
cal incidents, in particular providing a more carefully structured question¬ 
naire, containing more questions and clearer language. For instance, instead 
of merely asking students to "describe the situation," it would probably pay 


TESL CANADA JOURNAL/REVUE TESL DU CANADA 
VOLUME 32, ISSUE 2,2015 


105 


to be more specific—for example, "describe exactly what happened" —and 
include fields for respondents to report when exactly the incident occurred, 
who was involved, and so on. 

Number of incidents: The questionnaire requested only two critical inci¬ 
dents from students, one positive and one negative. In fact, most respondents 
obligingly provided more than two incidents. The more incidents collected, 
the richer and more valuable the data are likely to be. A further redesign of 
the questionnaire is therefore indicated to offer respondents the option of 
narrating multiple incidents. 

Response language: Although students were given the opportunity to re¬ 
spond in their own language, only one student did this. This majority choice 
to use English was helpful in some respects, but it was apparent from some 
of the responses that students were struggling to describe the incidents pre¬ 
cisely, and the quality of the data probably suffered as a result. Ideally, stu¬ 
dents at lower proficiency levels should be encouraged to respond in their 
own languages, potentially costly and more complex data analysis notwith¬ 
standing. 

Unintended consequences: The extent and depth of the responses varied 
immensely, from a couple of lines to, in several instances, an entire page. 
The researcher sensed an eagerness on the part of a number of respondents 
to express their opinions, which in some cases revealed strong emotions. An 
unintended consequence of the exercise for some participants, therefore, may 
have been the therapeutic effect of putting their views on paper. This insight 
lends further support to the rationale for carrying out some form of qualita¬ 
tive research, be it CIT or not, with ESL students. 

CONCLUSIONS 

This article offered a brief report on the CIT option for canvassing student 
satisfaction in conjunction with Johnston's (1995) differentiated quality fac¬ 
tors, and on some practical and theoretical aspects of designing and adminis¬ 
tering a CIT study for ESL. As is apparent from the above, the use of CIT for 
this purpose is not without its problems and controversies. Despite the extra 
investment in time and effort that CIT surveys imply, however, the major out¬ 
come for ESL teachers and managers could be some assurance around which 
service issues matter to students and which do not. Armed with fresh in¬ 
sights, managers could prioritize more accurately, allocating resources more 
efficiently and effectively, rather than misdirecting their efforts toward qual¬ 
ity factors that are, in fact, insignificant in student terms. It is self-evident, for 
instance, that hygienes and criticals should attract more managerial attention 
than neutrals. At the same time, overreliance on enhancers to generate satis¬ 
faction, while neglecting hygienes and/or criticals, could result, on balance, in 
dissatisfied students. It is not suggested that ESL managers abandon their 
current conventional tick-box surveys (assuming that is what they are using). 
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Rather, CIT could be used to complement these on a long-term basis, say once 
a year, possibly in conjunction with staff professional development activi¬ 
ties. This would allow for hitherto unknown issues to be identified as they 
arise, as the ESL operation grows and matures and as the student popula¬ 
tion evolves. Over time, managers and teachers could build up an invaluable 
database of incidents, which could further inform research and practice, for 
instance by identifying further quality factors specific to ESL. The option of 
collaborating with a university researcher on such a project would constitute 
a pragmatic application of Mode 2 Research (Tranfield, 2002), because a major 
CIT study of ESL student satisfaction would not only assist and inform the 
organization concerned, but would also make a major contribution to the 
field. Researchers contemplating this would be advised to consult Gremler's 
(2004) invaluable paper for advice on how to proceed. 
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Appendix A 

Definitions of the 18 Determinants of Service Quality 
(Johnston, 1995) 

Access: The physical approachability of service location, including the ease of 
finding one's way around the service environment and the clarity of route. 

Aesthetics: Extent to which the components of the service package are agree¬ 
able or pleasing to the customer, including both the appearance and the 
ambience of the service environment, the appearance and presentation of 
service facilities, goods, and staff. 

Attentiveness/helpfulness: The extent to which the service, particularly of con¬ 
tact staff, either provides help to the customer or gives the impression of 
interest in the customer and shows a willingness to serve. 

Availability: The availability of service facilities, staff, and goods to the cus¬ 
tomer. In the case of contact staff, this means both the staff/customer ratio 
and the amount of time each staff member has available to spend with 
each customer. In the case of service goods, availability includes both the 
quantity and the range of products made available to the customer. 

Care: The concern, consideration, sympathy, and patience shown to the cus¬ 
tomer. This includes the extent to which the customer is put at ease by the 
service and made to feel emotionally (rather than physically) comfortable. 

Cleanliness/tidiness: The cleanliness and the neat and tidy appearance of the 
tangible components of the service package, including the service envi¬ 
ronment, facilities, goods, and contact staff. 

Comfort: The physical comfort of the service environment and facilities. 

Commitment: Staff's apparent commitment to their work, including the pride 
and satisfaction they apparently take in their job, their diligence, and thor¬ 
oughness. 

Communication: The ability of the service providers to communicate with the 
customer in a way he or she will understand. This includes the clarity, 
completeness, and accuracy of both verbal and written information com¬ 
municated to the customer and the ability of staff to listen to and under¬ 
stand the customer. 

Competence: The skill, expertise, and professionalism with which the service 
is executed. This includes the carrying out of correct procedures, correct 
execution of customer instructions, degree of product or service knowl¬ 
edge exhibited by contact staff, the rendering of good, sound advice, and 
the general ability to do a good job. 

Courtesy: The politeness, respect, and propriety shown by the service, usually 
contact staff, in dealing with the customer and his or her property. This 
includes the ability of staff to be unobtrusive and uninterfering when ap¬ 
propriate. 
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Flexibility: A willingness and ability on the part of the service worker to 
amend or alter the nature of the service or product to meet the needs of 
the customer. 

Friendliness: The warmth and personal approachability (rather than physi¬ 
cal approachability) of the service providers, particularly of contact staff, 
including cheerful attitude and the ability to make the customer feel wel¬ 
come. 

Functionality: The serviceability and fitness for purpose or "product quality" 
of service facilities and goods. 

Integrity: The honesty, justice, fairness, and trust with which customers are 
treated by the service organization. 

Reliability: The reliability and consistency of performance of service facilities, 
goods, and staff. This includes punctual service delivery and an ability to 
keep to agreements made with the customer. 

Responsiveness: Speed and timeliness of service delivery. This includes the 
speed of throughput and the ability of the service providers to respond 
promptly to customer requests, with minimal waiting and queuing time. 
Security: Personal safety of the customer and his or her possessions while 
participating in or benefiting from the service process. This includes the 
maintenance of confidentiality. 

Appendix B 

Questionnaire Used in Pilot Study 

Please think about your overall experience as a student at this English lan¬ 
guage centre. Think about all the services included in the study package you 
have paid for. Consider anything to do with the service that is important to 
you personally. You can write your answer in English, or in your own lan¬ 
guage, if you prefer. 

Question 1 

• Think of a time when you felt very pleased and satisfied with the service 
you received from this English language centre. 

• Describe the situation: 

• Explain why you felt so pleased/satisfied: 

Question 2 

• Think of a time when you felt very unhappy and dissatisfied with the 
service you received from this English language centre. 

• Describe the situation: 

• Explain why you felt so unhappy/dissatisfied: 
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